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THE 1974 BRCADCAST EVALUATION PROGRAMME 



Aims 

9 

This report is one of a series of 18, based on evaluations of 35 
Open University progranmes carried out during 1974, by the^Audio^Visual 
Media Research Group of the Institute of Educational Technology, in 
conjunction with the BBC. 

What we are trying to do in these studies can be summarised as follows: 

1. to discover typical or pc^tential uses of broadcasting within a 
faculty area, to see whether these succeed, and whether improvements 
are needed, with the idea of generating information useful for 
decision-making in new courses likely to use broadcasting in a similar 
way. 

2. to provide producers with information about certain issues which arose 
during the making of a specific programme - for example, did students 
find a particular technique helpful or not? 

3. to discover practical difficulties encountered by students in using 
broadcast material (e.g. awkward transmission times, late mailing of 
related printed material, etc.), and possible ways of overcoming these 
difficulties. 

4. to produce information which will generate and test some assumptions 
made by the Audio-Visual Media Research Group about the uses of 
broadcasting in the Open University, and how students use or learn from 
broadcasts. Some of the questions to which we are seeking answers are: 

(i) to what extent do students benefit or suffer as a result 
of the position of a broadcast in a course? 

(ii) do students require more help in identifying the function 
of broadcasts and how to use them in their studies than is 
currently accepted in course production? ^ 

(iii) do course teams make the fullest use of the potential of 
broadcasting in the Open University situation? 

5. to involve producers and academics in a detailed evaluation study, 
with the aim of demonstrating some of the evaluation methods available, 
and how to select and use these methods, so that producers are more 
aware of what they might do themselves, and of the limitations and 
difficulties of certain approaches to evaluation. 

Criteria 

It can be seen that the emphasis in the studies is on the improvement of 
broadcasting as a teaching device. We are more concerned with learning how to 
make future programmes more helpful for students, than with passing summary 
Judgements on individual programmes » or on broadcasting as a whole. On the 
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other hand, it would be misleading for us to pretend that the evaluation 
reports were totally objective, and unsullied by the values held by the 
evaluators themselves, or by the producers and academics involved in the 
studies. For improvements to be suggested, some model, however vague, is 
necessary of what broadcasting ought to be doing in the Open University. 
For this reason, we will try to make explicit what criteria we have had in 
Mind whtn we have been studying programmes. 

First of all, we have been concerned to examine whether \;he broadcasts 
have been made with a clear educational intent, in the sense of providing the 
student with knowledge or experience relevant to the course he or she is 
pursuing. This is an important point, it is crucial to the likely 
acceptance of the evaluation reports, that our intentior.d here are fully 
understood. Certainly we have in general tried to avoid judging whether the 
educational aims of the programme ;fere the right ones, at this stage of our 
enquiries. Whether * particular way of using television or radio is appropriate 
in the Open University situation cannot be determined by evaluation of a single 
programme. A programme may fail for many reasons, none of which may be connected 
with the educational intentions underlying the programme, or with the way it was 
made. It is hoped, though, that as we increase the number of programmes 
evaluated, it will become clear that certain kinds of intention behind a progtiAmmc 
will be very difficult to achieve, that others require certain pre-requisites or 
conditions, while yet more can usually be achieved with ease in the Open University 
situation. In other words, we have tried to avoid commenting on whether a 
programme should or should not have chosen, as a matter of principle, for example 
a case study approach, or a particular topic as a case-study, at a certain point 
in time. What we have been concerned with, though, is whether there was at 
least some kind of educational purpose behind the choice of the material or 
approach, and whether in fact the students were able to discern this purpose, 
and use the material provided in a relevant way (even if the way the material 
was used was unanticipated). 

The question of whether a programme is relevant or not is much more 
complex. This is a judgement that we would prefer to leave to the course team. 
Nevertheless, the students* perception - rightly or wrongly - of a programme's 
relevance is of course crucial to the likelihood of the programme succeeding in 
its intentions, snd this has been ^n important part of our enquiries. In 
general, though, we have proceeded on the assumptions that the course team at 
least believes the programme has relevance to a course. 

Another criterion generally present in our evaluation of particular 
television programmes has been whether the prograume has been able to provide 
students with knowledge or experience which it would be difficult to provide 
as cheaply or conveniently in any other way in the Open University situation. 
It is not a criterion we would wish to apply mechanically, without other 
considerations being taken into account. There is considerable virtue in 
providing students with a variety of programme formats^ and under certain 
circumstances we recognise it will be more fconvenient or appropriate to use 
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television, when radio or print could well have been used instead. 
Nevertheless, television is a scarce resource within the University, and 
therefore we believe that our evaluation should concern itself to some extent 
with the potential of broadcasting for uniquely bringing certain knowledge and 
experiences to the student. 

A third ciiterion we have borne in mind is the extent to which the intended 
relationship between broadcast and text has been achieved, and the extent to 
which students have been able to integrate broadcasts with the rest of their 
activities. Occasionally, of course, programmes are deliberately designed to 
stand alone, but nevertheless there is usually some assumed relationship 
between broadcasts and text^, and so we have been concerned to discover whether 
students themselves have been able to make this integration. 

When preparing c!iese evaluation reports, we have tried to avoid incorporating 
in the reports our own judgements on the artistic or aesthetic quality of a 
programme. This is not because we have been uninfluenced by such factors, nor 
because we believe them to be unimportant. However, although we have very clear 
preferences for some programmes over others, which *nay well show through 

in some of the evaluation reports, our views on this aspect of a programme are 
not likely to be better based than anyone else^s. Furthermore, we believe that 
it would be very difficult to draw conclusions for future programmer-making 
as a result of an interpretation of the aesthetic quality of a programme. 
There are, as will become apparent from the evaluation reports, enough mundane 
matters which need to be altered or improved, without our having to enter this 
difficult area. Similarly^ we have not generally been too concerned with 
techniques of programme-making, except where we have been asked specifically by 
a producer or academic to investigate whether certain techniques have enhanced 
or impeded the educational aims of a programme, or where it has become clear 
from student responses that problems have arisen as a result of techniques used 
in the programme. The emphasis of the evaluation therefore is intended to be 
very much directed towards the educational aspects of the broadcasts. 

Evidence 

Besides trying to make explicit the criteria which have guided us in these 
studies, we ought also to clarify the relative importance we have given to 
various kinds of evidence. For instance ^ although obviously a programme stands 
a much better chance of achieving its objectives if it is rated highly by 
students, in terms of usefulness, interest, enjoyment, etc., we have not been 
content to accept this as a main criterion, for a number of reasons* It will 
become clear on reading our studies' that students or even tutors are not always 
the best judges of the relevance or. even the intellectual weight of a programme. 
Furthermore, students vary in their reaction to different programmes, and 
frankly we are more interested in discovering why a programme helps one group of 
students and not another. 
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Nor hive we put heavy reliance on the more classical type of evaluation 
evidence y that derived from performance tests. The main aim of a proframme 
is seldom to introduce important and fresh cognitive content. If the ideas are 
that important, they are nearly always dealt with in the correspondence texts as 
well. Therefore it is often impossible to deduce from performance testa alone 
what a student has learned from the broadcast , and what he has learned through 
the correspondence text. In addition, performance tests rarely indicate what 
corrective action is necessary to improve a profiamme. Th*re are often other 
important aims behind a programme which are not strictly content-based, and many 
of the reasons why programmes do not succeed as well as they might have nothing 
to do with the actual content of the programes. Performance testing therefore 
is, on its own , too narrow a base for evaluation, but nevertheless it still has a 
useful role in our studies, used in conjunction with other evidence. 

Group discussions can be extremely useful for generating ideas about why 
programmes h;ive succeeded or failed, and what kind of improvements could be made. 
However, a group discussion can also be very untypical of the general student 
reaction to a programme. The initial reaction of the first student to respond 
to the programme tends to set the tone for the rest of the group. Furthermore, 
students usually watch in isolation, rather than in groups, and the group 
situation stimulates students to think about a programme in a different Way to 
that of the isolated stu'ient. 

Evidence from the standard University feedback sources, such as CURF (the 
Course Unit Report Form), CT4 (Course Tutor Reports), and Staff Tutor reports, 
is sometimes lacking for a specific programme, and when it does exist, is 
usually not detailed enough. Furthermore, both CURF and CT4 suffer from low 
response rates, and so one is never sure whether the information is representative. 

Finally, even specially designed questionnaires, based on a representative 
sample, and with high response rates, suffer from the superficiality of response 
to the questions set* Telephone interviewing can sometimes overcome this, but 
40% of our students do not have telephones. 

It can be seeri therefore that every source of evidence, taken alone, has its 
drawbacks. . We have therefore tried to create a situation where information from 
a wide variety of sources has been collected, so that with the relevant producer 
and academic we can build up a coherent picture of the way a programme has been 
used by students, the relationship of the programme to the rest of the course, the 
consequences xor different kinds of student, and ways in which the programme 
could be made of more benefit to students. 

Method 

To do this, we have developed a method which we have used fairly consistently 
in nearly all the 18 studies, and which we hope to continue to use in 1975. 

We invited in late 1973 senior producers in each of the six faculty areas to 
suggest between three knd five programmes each, which were examples of typical 
or potential uses of broadcasting within a faculty area. Bach senior producer 
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responded, and when the offers were examined in detail, it became clear 
that in some cases two or more programmes were linked together | and could 
be examined within one study. In effect, we were offered altogether 21 
television programmes and six radio programmes. One television programme was 
not evaluated, as we were given the wrong programme number, and another 
prograwne was not evaluated because of pressure of work. In addition, we 
were also involved in a separate study of M231 (Analysis) which includes 
an evaluation of a further six television and four radio programmea (Ahrens, 
Burt and Gallagher, 1974). Thua the following programmes were included in the 
1974 evaluation ^programme: 

TABLE 1, Prograwwes evaluated in 1974 



CV • XUS b JLun 












Report 






Television 


Radio 




No. 


Faculty 


Course 


pro£ramiaea 


programiBes 


" Bvaluators 


1^ 


Ar bS 


A302 


TV9 




Gallagher 


1 R 

xo 




AMST2R3 


1 T O 




Bates 


6 


Social 


DS261 


TV4 




Gallagher 


7 


Scxences 


DS261 


TV6 


Radio 9 


Bates/Roberts 


1 1 






TV7 




Gallagher 


2 


Educational 


B221 


TV3 


Radio 6 


Gallagher 


8 


Studies 


£221 




Radio 15 


Gallagher 


17 




£283 


TV6/7/8 




Gallagher 


1 c\ 




C«?^X 


'TV4 / S /6 


Radio 7 


Bates 


I 


Mathematics 


M231 


TVl/2/3/4/ 
5/6 


Radio 1/2/ 
3/4 


Gallagher 


12 




MI3T241 




Radio 4 


Gallagher 


4 


Science 


S24- 


TV7 


Radio 3 


Gallagher 


9 




S323 


TV9 




Gallagher 


16 




SM351 


TV7 




Gallagher 


5 


Technology 


TlOO 


TV26 




Gallagher/Roberts 


13 




T241 


TVll 




Bates 


14 




T241 


TV12 




Batea 


3 




T291 


TV6 




Bates 


18 




15 


25 


10 
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The way the sample of programmes was drawn requires Justification. This 
was the first time that a detailed evaluation of a series of proframnes had 
been attempted. (Two previous studies in 1972^ one on B283, TV4/S and Radio 9, 
and one on MST282, TVl-'4 had been attempted, but at the expreaa requeat of the 
producers involved). It was therefore neceaaary to enfure co-operation from the 
BBC. It was considered that the atudy would be more welcomed LT the BBC itself 
was allowed to suggest the programnes to be evaluated. In any caae, with over 
800 television programme* and a aimilar number of radio programmea current 
in 1974, it was Impossible either to chooae a aample large enough to be 
representative of the whole BBC/OU output within the reaourcea available, or for 
us ourselves to have a broad overview of the total production of programmes. We 
believe that the Senior Producer is in the beat poaition to know the fulX range of 
output within his faculty area. Indeed^ a major intereat for ua waa to aee what 
kind of programmes would be offered. In any case, it must be remembered that 
the aim of the evaluation. is not to evaluate broadcasting aa' a whole, but to 
try to improve the use of broadcaating. If the programmea offered were 
therefore indeed representative of even Just the future thinking of the 
producers in a given faculty area, this would be sufficient for our purpose. 
The danger of course is that programmes which are considered to be especially 
outstanding, or programmes where there is profound disagreement between 
producers and academics about their value, might be offered instead, fiven 
should this have happened, though, there would be value in thia. In effect, we 
were offered a very wide range of programme. Many without doubt were typical, 
while one or two were pointers to possible new developments in the use of 
broadcasting. The main weakness was the small number of radio programmes 
offered. Only two of the ten radio programmes were specifically offered, the 
remainder being dragged In through being linked to television programmea. 
This pattern In fact is being repeated in 1975. It is very difficult to obtain 
recommendations for radio programmes for evaluation, and this - together wicn 
some of the evaluation results - does suggest a serious undervaluing of radio, 
even in the BBC. 

Once the sample had been settled, a work-plan for the year waa worked out, 
to ensure a spread of work-load across the year. This led to programmes being 
allocated to each of us, six studies to Bates, and twelve to Gallagher. Between 
two and four weeks before the repeat transmission of a programme we would view 
the programmes on video tape, skim-read the text, supplementary material, and 
course guide, looking at the relationship between the text and programme, and 
then go and see the producer, and where possible the academic reaponaible. This 
Interview was informal and unstructured, but the aim of it was to determine what 
the producer and academic were trying to do in the programme, what they would 
like ua to find out, and any special difficulties which were encountered in 
getting the programme made, or difficulties anticipated when the programme was 
transmitted. Producer and academic were Interviewed separately. These 
interviews and our examination of the broadcaat and relevant printed material 
provided us with the basis for a questionnaire. Occasionally, where the 
subject matter was particularly difficult, the educational technologist attached 
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to the course team would provide help in explaining or sugfesting diff iculties, 
and in the wording of certain test- type** questions. The draft of the 
questionnaire was then circulated to the producer and academic » for their 
further suggestions and approval, and to the University** Survey Research 
Department, for an independent view on the wording of questions. At the same 
time, the University Data Processing Division was asked to produce a random 
sample of generally about 200 students, with three sets of address labels, for 
postal questionnaires, and un independent random list of 50-100 students with 
telephones. This sample was drawn to avoid students on other studies (e.g. 
CURF). It was considered the minimum number necessary to give a reliable 
sample on each course (see the report itself for its error factor , as this 
varied from study to study.) 

The questionnaires varied from study to study, but most contained questions 
about if or when the students watched or listened, reasons for missing the 
broadcast> (if they had missed it), whether they had read the unit and broadcast 
notes before or after seeing the programme, and where they were in the course, 
how useful, enjoyable, and difficult they found the programme, what they thougnt 
the purpose of the programme was, usually some questions about the content of the 
programme, sufficient to assess whether they had understood what the programme 
was about, and then questions specific to the programme being studied. Students 
were also usually asked how they were finding the course. A feature of all 
the questionnaires was the combination of pre-coded and open^'ended questions. 
Students were asked, for instance, not only to rate the programe on a fixed 
scale of usefulness, but also to give reasons for their answer. The questionnaires 
were posted to arrive within five days of the second transmission of a 
programme. (Where two or more programmes were involved in a single study, the 
procedure varied, according to circumstances)* A reminder was sent within 10 days, 
and a second reminder within another 10 days. These reminders boosted response 
rates considerably, most averaging over 70%. 

On some studies (9 in all), the postal questionnaires were backed up by about 
50 telephone interviews. These were used where there were doubts about whether 
a postal questionnaire would provide the information required in sufficient 
depth. The telephone interviews also proved useful as a general cross-check 
with questionnaire information. The interviews would be carried out over a 
period of five days in the evenings, by the whole evaluation team, sometimes 
supplemented by part-time - but trained - interviewers, and sometimes the 
producer was also us^d as an interviewer. In one instance, a group discussion 
was held with six students by telephone, using conference-call facilities. 
The decision whether to use telephone interviewing was also governed by the 
work-load in a particular week. Thus, on some enquries, although it was 
desirable, it was not practical. 

Again on some studies (6 in all), group discussions were arranged, where 
the programme was shown to a group of students. The procedure was to contact 
a staff tutor and find out whether any classes ot day-schools were arranged 
within a week of the transmissions. Sometimes a discussion could be specially 
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ar ranged. We would copy the progrtmrne from 1*' Ampex on to cassette | and 
take a vCR nacltine to the study centrei and show the programme to about 10-30 
"/ludents. (Staff tutors had usually written to students to tell them we were 
coming, or even to invite then specially.) The discussion would be deliberately 
loosely-structuredy led by the evaluator. Sometimes the producer attendedi 
but was not always announced. The first question was usually: *'What did you 
think of the programme?" The evaluator would normally have a range of questions 
prepared. In mOi>t cases , it was not necessary to put these questions, since 
they tended to be covered spontaneously in the discussioni but if the 
discussion began to drift away from t£e "programme ^ one of these questions would 
be asked, in order bring the discussion back to the programme. The 
discussion was sound recorded , and later transcribed. The aim of these 
flincussions was to obtain ideas about the programme and what it meant to 
students, which we could not anticipate. Ideally, we would like to have based 
the postal questionnaire on the discussions, but these discussions had to be 
held after the transmission, and there was insuf f ici^*^t time to incorporate 
points from the discussions in the questionnaires. Used in conjunction with 
questionnaire, and other data, however, the discussions are useful for 
providing insight into student's ideas about broadcasting and how they use it. 
There is considerable evidence though from the evaluation reports that such 
discussions can give a very misleading impression of general student reaction, 
particularly if the producer is present. We also tried to hold group 
discussions at suniner school for three of the studies, but these turned out to be 
either impossible to carry out (no-one turned up for two) or of no value for our 
purpose) . 

Finally, wc have made use of other feedback information available, 
particularly course unit report form data, course tutor feedback from the CT4, 
and CMA feedback. 

Pre-coded data from postal questionnaires and telephone interviews are 
hand-connted, and the open-ended comments are typed for each question. The 
quantitative and qualitative Jata are then sifted, and with manual cross-checks, 
a general picture is built up in the form of a full report. This report draws 
not only on information from this specific enquiry, but also on information from 
the other studies. This cumulative build-up of information is extremely 
important. For instance, a finding which looks none too solid in i single study - 
because, for example, it may be based on small numbers - becomes much more 
significant when the finding is repeated in several different independent studies. 
Similarly, a finding which has a number of possible explanations in one study can 
be more confidently explained in the light of similar findings in other studies. 
We have in fact waited until data from all 35 programmes haye been collected 
before the first evaluation study has been written (with the exception of the 
M231 study.) 

Nevertheless, it would be wrong to stress too heavily the level of 
certainty of our findings. We do not wish to give a pseudo-scientific gloss to 
our enquiries. It must be remembered that these 18 studies were carried out over 
a period of Just six months (April to September 1974), The entire team 
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consisted of two cvaluators, a research assistant (Carrie Roberts) a 
secretary shared with other lET staff, and a "spending" budget of £1500 for 
the whole year. In addition, the Group was involved in other major studies 
(e.g. piloting a VCR system in study centres) and heavy committee work. 
Nevertheless, a new study was being started almost every week during the 
six-month period. The actual combination of methods used was often just as 
much due to matters of expediency as to carefully designed research method. 
Nevertheless, we believe we were right to go for as many progrannes as 
possible, and a wide variety of sources of information even if this has 
meant obtaining "quick and dirty" information. Table 2 summarises the sources 
of information available and used in each enquiry. 



TABLE 2 . Sources of Information Used on Each Enquiry 
Specially 
Evaluation designed 



Report 




postal 


Telephone 


Group 




CMA 




No. 


Programmes 


questionnaire 


interviews 


discussions 


CURF 


(feedback) 


CT4 


15 


A302/TV9 


X 


- 


X 


X 


- 




18 


AMST283/TV8 


X 






X 




X 


6 


DS261/TV4 


X 


X 


- 


X 


- 


X 


7 


DS261/TV6 


X 


X 


X 


X 




X 


11 


0r2Ol/TV7 


X 


X 


X 


X 






2 


E221/TV3/ 
Radio 6 


X* 








X 


X 


8 


E221/Radio 15 X 




X 




X 


X 


17 


E283/TV6 8 


X 






X 


X 


X 


10 


E351/TV4 6/ 
Radio 7 


X 


X 




X 






1 


M231/TV1 6/ 
Radio 1 4 


X 


X 




X 


X 




12 


MDT24l/Radio 


4 X 


X 




X 




X 


4 


S24-/TV7/ 
Radio 3 


X 


X 






X 


X 


9 


S323/TV9 


X 




X 




X 




16 


SM351/TV7 


X 


X 










5 


T100/TV26 


X 






X 




X 


13 


T241/TV11 


X 








X 




14 


T241/TV12 


X 








X 




3 


T291/TV6 


X 




X 




X 


X 


18 


18 


18 


8 


6 


10 




10 



* = questionnaire also sent to tutors 
** = tried, but failed 
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At the same time, because wc have been in a unique position of having studied 
a number of programmes across all faculty areas » we have risked interpretation 
and occasionally speculation. This explains why we have prepared such a full 
report y with as much information as possible available* We hope that the 
report is presented in such a way that the reader can draw his or her own 
conclusions about the validity of the results, and our interpretation of the 
results. In the long run, we believe that the real value, if any, of these 
reports will be in the stimulus and thought they provoke amongst those concerned 
with using broadcasting, rather than with the specific recommendations and 
conclusions. However, for those too busy to work through the full report, we 
have made recommendations and conclusions, and produced these in the summary. 

Finally, just as important for us as the results themselves has been the 
co-operation that has resulted between producers, academics^ students and 
ourselves. Hiese evaluation studies have been, without exception, supported 
in every possible way by BBC producers, students and OU academics. Frankly, we 
underestimated both the amount of work involved for ourselves, and the 
willingness of producers and academics to engage in the actual process of 
evaluation, and we hope to involve both groups more fully in 1975« The 
evaluation studies are due just as much to the efforts of students and the 
academic and production staff, as to ourselves* At the same time, just as the 
producer has to take the final responsibility for s programme, so we mu^t take 
final responsibility for these evaluation reports. They do represent in the main 
our own views, and we must take responsibility for any errors or offence caused 
by the report. 
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rm TELEVISION PRCXSRAMME IN CO^r^BXT 
The Course 

Television programme 6, »»Fourier Analysis and Transducer 
Response", is part of the T291 course, »»Instrumentation . " This 
is a second-level, half -credit Technology course of 16 units, 
with 11 television programmes and eight radio programmes. The 
introductory hcindbook to the course states that the overall aim 
of the coarse is to explain the functioning and operation of 
instrumentation systems and their component parts. When 
students have completed the course, they should: 

1. have clear ideas about what instrumentation does and 
the types of application for which it is used; 

2. appreciate the problems which arise in employing 
instrumentation systems, both with the components 
themselves and the systems as a whole; 

3. be aware of some important techniques used for measur* 
ing a number of physical variables selected by the 
course team; 

4. be able to choose wisely between two alternative 
suggested implementations of an instrumentation 
requirement ♦ 

The course assumes no previous knowledge of electronics. 
The major areas covered by the course are: 

1. What is meant by "instrumentation** in this course. 

2. The function of an instrumentation system. 

3. The role of a transducer in an instrumentation system 
and how some common transducers work. 

4. The concept of signal transmission and transmission 
path, with examples of these concepts. 

5. Examples of sioinal processing. 

6. How signals may be obscured by noise and how signals 
can be recovered from noise in some cases* 

7. Methods of recording and displaying data, illustrated 
by examples. 

The Units . 

The programme is associated with the fourth block, covering 
Units 8, 9 and 10, entitled; *'Transducers 2: Acceleration, 
Vibration, Velocity,, Flow.** The block is mainly about 
transducers used for the measurement of motion: motion of 
solids, liquids and gases. The correspondence text states that 
the block has three main aims: 

1. to introduce the student to acceleration, vibration, 
velocity and flow transducers and to the principles 
on which their operation is based 
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2. to study second-order linear systems, involving ideas 
of systems, linearity, frequency spectra, and Fourier 
analysis 

3. to introduce the student to the properties of fluid 
flow, on which depends the operation of flow- 
transducers • 

The television programme 

The introductory handbook to the course states three aims 
for television on the course: 

1. to illustrate applications of instrumentation in ways 
that the written word and stationary picture can 
never do because the situation is essentially dynamic, 
or on so large a scale that the impressions of size, 
and difficulty of the environment, can only be gained 
by »»going there" through the lens of the television 
camera 

2. to explain some of the more difficult concepts of the 
course, those which are essentially dynamic, or three- 
dimensional, where television is the only way the course 
team can hope to help the student understand 

3. to show the student instrumentation hardware and how it 
is used, to fill the gap created by the impossibility 
of providing students with the sort of home kit which 
the course team would ideally like to send students. 

The aims of television programme 6 were not specifically 
stated to the student, but were given to us by the producer and 
agreed by the academic responsible for the programme as: 

1. to make students aware of the need to know the exact 
response of each transducer used in a complex system 
when readings have to be taken together 

2. to aid students* understanding of Fourier analysis and 
synthesis 

3* to teach students how to plot the frequency resF>onse of 
an accelerometer • 

These three aims overlap with some of the objectives of the 
correspondence text, particularly with those concerned with 
Section 6 of Part 1, roughly corresponding to Unit 8, 

The programme has quite a complex structure. It consists 
primarily of three separate content components, roughly equival- 
ent to the three aims for the programme, it is necessary to 
explain this structure, because it has implications for some 
of the later results. Table 3 indicates the presenters, the 
content and the equipment or visual material displayed. 
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TABLE 3« Structure of Televiiion Programme 6 
' ^Fourier Analysis and Transducer Response" 



PRESENTER 


CONTBffT 




EQUIPMBNTAISUALS 


j 


Th# nrocrfs.Tnmfl ODsns with film o£ two 
examples of pneumatic actuators* 


30" 


Film 


1 
1 

Gaby Smol 


Gaby Smol then introduces the programme^ 
explaining the need to measure how friction 
varies during the stroke , and that an 
experiment will be shown to see how this can 
be done, and how Fourier analysis can help. 
He points out that Fourier ideas involve 
sinusoidal responses , and so the programme 
will look at sinusoidal response in a couple 
of transducers* 


30" 


Smol in 
studio 




Gaby Smol then demonstrates how an actuator 
works, and the need for designers to measure 
the seal friction in actuators* 


36" 


Caption 
Graphic 




Film of an experimental situation at Bath 
University to measure seal friction in 
actuators is then shown* 


1*3" 


Film 




This is followed by a diagram showing the 
placing of transducers to measure acceler-* 
ation and air-pressure in the Bath 
University experiment* 


49" 


Caption 
^ Graphic 


1 


It is then pointed out with the help of a 
graph of the measurements of seal friction 
in an actuator, that the accurate measure- 
ment of friction depends on all transducers 
measuring at the same point in time* The 
response of the transducers must be adequate , 
and this can be discovered by looking at the 
specification of the transducers. These 
can be given in terns of sinusoidal response* 
Sinusoidal response can be interpreted in 
terms of Fourier analysis PART 1 


1«38" 


Smol with 
grai^ic on 
magnetic board 
in studio* 




5«6" 




i 

j 


ovnn o^w&jwca bii^ii ucniuiiv vk^s vcb iiuw a wave 

form synthesiser works | with the help of 
a graphic* 


7" 


oparKCB wxwn 
Wave-form 
synthesiser and 
oscilloscope in 
studio* 


1 John 
1 Sparkes 

i 


The synthesiser consists of a number of signal 
generators, each of which is a sin^^ave 
generator. The outputs froa these signal 
generators added together and 4ts|s4«j^ 
on the oscilloscope* The example given is of 
a fundamental sin4-wave plus hafMOoic^ h> 


37" 


Caption 
Graphic 


1 


Adding together the first, third, fifth and 
seventh harmonic, the wave-form synthesiser 
produces a square wave* Sparkes points out 
that if a transducer could deal with a 
frequency only up to the seventh harmonic of 
the fundamental, in response to a square«wave 


1»18" 


John Sparkes 
with Wave-form 
synthesiser and 
oscilloscope in 
studio 
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PRESENTER 



CONTENT 



TIME 



BQUIPMBNTAISUALS 



'4hea^jr(\fji^ t then that la the sort 

of output one would get* Fourier 
synthesis reveals that kind of property. 



David 
Crecraf t 



To show how sio«-wavea can be built up, 
a mechanical model of a air>«.*wave generator 
using a wheels a pulley, atring and moving 
paper, and a mechanical model of a wave« 
form synthesiser, using a combination of 
wheels and pulleys, are demonatrated. 



3 '31" 



David Crecraf t 
with two large 
mechanical models 
in atudio. 



Sparkes then points out that it is 
necessary to analyse a complex wave such 
as a aquare wave. 



21" 



John 
^pirkes 



Sparkea with wave- 
form aynthesiaer 
and oacilloscope 
in atudio* 



Using a caption graphic, Sparkes demonatratea 
how a spectrum analyser breaks down a 
complex wave into its component parts. 



43" 



Cttpt ion- 
Graphic 



This is then demonstrated using the spectrum 
analyser and the oscilloscope, showing on the 
oscilloscope plots of the amplitude of 
component sine-waves against the frequency* 
bparkes points out that a spectrum analyser 
does not indicate the effect of t)'hase , though. 
Using the synthesiser and oacilloscope, he 
demonstrates how phaae shift of one harmonic 
grossly distorts the square wave, without 
this> being registered by the spectrum analyser 



Sparke«, with 
aynthesiaer and 

oacilloscope 
in atudio. 



David 
Crecraf t 



Using the mechanical model, and by shifting 
the phase of one wheel (3rd harmonic) by 80^, 
the same distortion is shown 



1'23'* 



Crecraft with 
mechanfcal model 
in studio. 



John 
Sparkes 



If there is a linear phase reaponae, i.e. the 
phase shift is proportional to the frequencies 
of the various ai, -waves, the output of a 
transducer is never theleaa manageable. Uaing 
the synthesiser -and oscilloscope, Sparkes \ 
demonstrates that linear phase response 
producea a faithful but delayed response. This! 
applies to all complex wavea, not just square, - 
waves. Delayed or linear phase shift is 
important when considering two transducers ^ 
together, as in the actuator example. The 
point is made that it would be very unwiae to \ 
have one transducer with linear phase shift and 
another with zero phaae shift, since subatraction 
would be difficult to meaaure accurately. 

PART 2 



Sparkea, with 
aynthesiser 
and oscilloscope 
in studio. 



1'55*" 



12» 24' 



Gaby 
Smol 



Equipment which can measure phase and 
amplitude of the retfponae of accelerometers 
is introduced. Two accelerometers, one damped, 
one undamped are mounted on a table. The 
equipment is described in the programme aa 
follows: "(The accelerometera) are mounted 
on, a shaker table - which ia rather like a 
large moving coil loudapeaker - Mcwaa by a 
sinusoidal current ao that the accelerometera 
are given a sinusoidal acceleration. They are 



1'18" 



Smol with 
shaker table, 
two acceler- 
ometers and 
oscilloscope 
in studio. 
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TABLE 3 (Cont,) 



PRESENTER 


CONTENT 


TIME 


EQUIPMENT A ISUALS 


Gaby 
Smol 
(cont.) 


given this acceleration by a swept 
oscillator « This oscillator produces 
a current which can be swept in. t-nc^t^ 
so that the frequency of the applied 
accei.erations can be increased gradually. 
The output of the accelerometer is Vsak^A 
to (an) oscilloscope''. There follows a 
description of the accelerometera , with the 
help of a demonstratioa and a graphic* 






The motion of the spring of the accelerom*- 
eters is detected by strain gauges and 
fed to an oscilloscope to give the 
acceleration. This enables the phase 
response of the accelerometers to be 
measured. 


22" 


Caption 


Equipment is operated , with the undamped 
accelerometer 1 and the reading on the 
oscilloscope is observed, and then repeated 
with the damped accelerometer. With the 
undamped accelerometer , the amplitude 
increased suddenly and dramatically at the 
natural frequency of 250, while with the 
undamped accelerometer, the response is 
substantially flat over a wider range of 
frequencies.' Thus, if concerned purely with 
amplitude response - e.g. for friction 
measurements - it is pointed out that one 
would choose a damped accelerometer. For 
phase response, the ^tP'^''*^^^ slso has a phase 
detector. The A^fAfaitji is switched over to 
phase response, so instead of displaying 
amplitude, the phase difference between 
applied acceleration and the output of the 
accelerometer is displayed. The effect of 
this on the undamped accelerometer is 
displayed on the oscilloscope. There is no 
phase o>>A^5e up to its natural frequency, 
where the phase response suddenly jumps. The 
trace is left on the oscilloscope, then the 
operation is repeated for the damped 
accelerometer. Ther^ is a linear variation 
of phase with frequency, and phase change ab tt>e 
tvitor<4 Ui ofcbufc Mf >46itie (crW^ciXt^ it 
i$ pointed out that this would be acceptable 
in an application where a time-lag was 
unimportant - but not in friction measure- 
ment. In such a situation, one would either 
have to use an undamped accelerometer, and 
use^t below the natural frequency so as to 
get^ amplitude response level, or use a 
damped accelerometer below its natural 
frequency to g«t negligible phase shift. 
Natural frequency and damping are what 
control the sinusoidal amplitude and phase 
response of accelerometers. Students are 
informed that details are ^iven in the unit. 
Finally, it is pointed out that for ^trans- 
ducers which behave like second order^ systems, 
their response can be forecast from knowledge 
of the natural frequency, and whether they 
are adequate can be forecast from knowledge 
of Fourier spectrum of quantity they are 
trying Ico measure. 

PART 3: Timci 


4 •50" 


Smol with 
shaker table, 
oscillator, 
two 

acfcelerometers 
and oscilloscope 
in studio. 


6*30" 
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It can N» soon from Table 3 that the programme uses a wide 
variety ot techniques; film, "talking head", magnetic board, 
mechanical models of an electronic process, demonstration of 
equipment, and measurements observed on the oscilloscope* The 
following equipment and instruments were demonstrated or shown in 
the programme: 

pneumatic actuators 

transducers 

accelerometors 

wave-form synthesiser and spectrum analyser 

oscilloscope 

shaker -table 

oscillator 

damped and undamped accclerometer 

In addition, three separate presenters were used, each being 
identified with a clear topic area« 



As well as the three aims specified by the producer and 
academic, it can be seen from Table 3 that the programme was also 
covering some of the general aims for the use of television in the 
course. Thus the programme included applications of instrumentation, 
explanations of some of the more difficult concepts of the course, 
where the situation is essentially dynamic, and also demonstrations 
of instrumentation hardware and how it is used. A feature of the 
programme was the specially constructed models, designed to show 
mechanically how complex waves are built up from the component 
sign-waves . 

The Broadcast Notes and Supplementary Material 

The broadcast notes are given in full below: 
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T291 Inatruiientation 
Television Progrmnme 6 

First tCAnsiiissions 06*40 Monday 27 May 1974 
Second transniaaion: 19.05 Friday 31 May 1974 
Title: Fourier Analyaia and Tranaducer Reaponae 
Speakera: Gaby Smol 

David Crecraf t 

John Sparkea 

Remember to fill in Q.* Y4 of your CMA T291 45 form 
after watching thia profranne. 

An experiment to neaaure the friction of a piston 
seal provides examplea of practical cequiresenta on 
the reaponae of tranaducera to time-varying inputa. 

A transducer's reaponae to complex time-varying 
inputs can be evaluated in terms of its response to 
ainusoidal inputa* This can be done uaing Fourier 
analysis and ayntheaia. The analyais and 
ayntfil^ais of an eaaily recognized wave-form - a 
squtre wave - are demonatrated in the programme. 

The sinusoidal reaponae* of two tranaducera, which 
can be modelled aa second-order ayatems having 
different damping factors, are diaplayed on an 
oacilloacope. The transducers, a couple of 
acceleronetera, are mounted on a mechanical ahaker 
table. An automatic awceper ia uaed to vary the 
frequency of vibratioj), and plota of amplitude and 
phaae responae agalnat frequency are Obtained. 
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The course team were well aware of the brevity of the broadcast 
notes, but fuller notes were not prepared because the main topics 
dealt with in the programme were treated in more detail in the first 
part of the correspondence text, which the student was supposed to 
study before seeing the programme. Nevertheless, broadcast notes for 
other programmes were much more extensive. 

The tutor-marked assignment, one of four counting towards 
continuous assessment, contained two questions. Television programme 
6 was directly relevant to the first question which carried 40 per 
cent of the assignment marks, although the question could be 
answered by reference to the correspondence text, as well. The 
question was worded as follows: 

The clarity and conciseness with whict^ you 
present your material will be taken into 
account when assetsing this assignment. 

Question 1 

(Carries 40 per cent of the assignment marksj 

*If the behaviour of a transducer can be 
modelled by a linear system, the response of 
the transducer to any time-varying input can, 
in principle, be evaluated using the 
techniques of Fourier analysis and synthesis.* 

Justify the above statement; 

(a) by explaining what is meant by Fourier 
analysis and synthesis; 

(b) by describing the relevant properties of 
linear systems; 

(c) by explaining how these properties can be 
used, in conjunction with Fourier analysis 
and synthesis and with the known sinusoidal 
(frequency) response of the transducer, in 
order to evaluate its response to a time- 
varying input having a known frequency 

; Spec t rum • j 

In addition, CM/V T291 45, one of seven computer -marked assign- 
ments counting towards continuous assessment included one question 
(carrying though less than 5% of the marks) which drew on material 
covered in the broadcast. 

The Timing of the programme . 

A feature of the T291 course is the course calendar, which, 
using colour coding, clearly indicates key dates for students, and 
also allows space for additional information to be added. The 
calendar sets out the planned mailing dates of tmits, the trans- 
mission dates for television and radio programmes, and the due and 
cut-off dates for TMAs and CMAs . (This was one of the most useful 
and clear calendars we have come across, and a copy is included in 
Appendix A). However, units 8, 9 and 10 did not go according to 
plan in 1974. It will be remembered that 1974 began with Britain's 
worst industrial conflict si nee the Great Strike of 1926, culminating 
in the three-day working week. One of the effects of this was to 
delay the* printing of Block 4. Instead of being received by May 18th. 
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Just over a wook before the first transmission of television 
programme 6, the units were not mailed until June 19th. The planned 
and actual dates are set out in Table 4. 



TABLE 4. PUnned and actual dates for Block 4 (Units 8, 9 and 10) 



ERLC 



MAY 



JUN£ 



JULY 



PATH 

Saturday nth 
Monday 13th 


PUNNED 

1WA02<Units 3 and 4) cut-off 
CMA43(Units 5 and 6) due 


THURSDAY 16TH 7a0pm 
SATURDAY 18TH 7.00am 


RADIO 4 (UNITS 8,9,10-INTRO) 
RADIO 4 (REPEAT) 
RBCBIPT OP BLOCK 4 
BBGIN WOKK ON UNIT 8 


Monday 20th 


CMA44 (Units 5,6,7) due date 


MONDAY 27TH 6.40am 
THURSDAY 3 1ST 7.05pm 
MONDAY 3RD 


TBLEVISION 6 (UNIT 8) 
TBLBVISION 6 (RBPBAT) 
BBGIN WORK ON UNIT 9 


Saturday 8th 


CMA43 (Units 5 and 6) cut-off 


TOURSDAY 13T>1 7.10pm 
SATURDAY 15TO 7.00am 


RADIO 5 (UNITS 8 and 9) 
RADIO 5 (REPBAT> 


Saturday l5th 


CMA44 (Units 5,6,7) cut-off 


MONDAY 17TO 6.40am 


THUVISION 7 (UNITS 8,9,10) 
BBGIN WORK ON UNIT 10 


Wednesday 19th 


FRIDAY 21ST 7.05pm 
MONDAY 1ST 


TBLBVISION 7 (REPEAT) 

CMA45 (UNITS 8,9,10) iJUB DATE 


Monday 1st 


Begin work on Unit 11 


[MONDAY 


TWA03 (UNITS 8,9,10) DUE DATE 


Monday 15th 
Monday 22nd 
Thursday 25th 
Friday 26th 


Begin work on Unit 12 
Television 8 (Unit 11) 
Radio 6 (Unit 11) 
Television 8 (repeat) 


(SATURDAY 27TH 


*CMA45 (UNITS 8,9,10) CUT-OFF 


Saturday 27th 
Monday 29th 


Radio 6 (Repeat) 
Begin work on Unit 13 


tsATURDAY 3RD 


TMA03 (UNITS 8.9.10) CUT-OFF 



ACTUAL 
as planned 



NO BLOCK 
4 



f 

as 

planned 
]L_ 



NO BLOCK 4 



as 

planned 



NO BLOCK 4 



BLOCK 4 MAILED 



BLOCK 4 ARRIVESI 



as 

planned 



It can be seen that the dates had been very carefully planned to 
ensure that students working on schedule would complete work in 
Units 5, 6 and 7, and still have a week to study Unit 8 before the 
first transmission of the Television Programme 6. However, it can 
also be seen that Units 8, 9 and 10 did not in fact arrive until 
six weeks after the planned date. Fortunately, since the cut-off 
dates (the last dates for accepting assignments) for CMA45 and 
TMA03 - the assignments associated with this block, - were not until 
27th July and 3rd August respectively, most students were still able 
to complete their studies of Block 4 in time to complete their 
assignments. Even so, the mailing delay was very unfortunate since 
Television Programme 6 had been planned on the assumption that 
students would have studied Unit Or before watching. Although the 
programme was not transmitted under the conditions planned by the 
course team, this is not an infrequent occurence in courses in 
their first year of presentatioli (see Bates, 1973, and Evaluation 
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Report No, 2)* Therefore, one of the aims of this particular 
evaluation is to examine just how much information students were 
able to gain from the television programme alone, even though it 
was not made with that intention. This is important because even 
when mailings are on schedule, there is strong evidence from other 
studies to suggest that many students will not have studied the 
relevant units before the transmission of a programme (see 
Evaluation Report No, 1), 
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EVAUJATION OP THE mBVISION PROGRAMMB 



The programme was discussed with the producer and the course team 
chairman. As well as discovering how much atudcnts were atle to pick up from 
the programme without having read the unit, there was a nun.bor of other 
questions of interest to the producer and courae«-team chairmen* 

1. One problem was that some students were likely to have studied 
Fourier analysis on other courses, particularly TS282, and TlOO, 
whereas otheo would be raeetiniT it -Tor the first tine, since the 
course assumed no previous knowledge of electronics. Would the 
programme help those without previous experience of Fourier analysis 
und still prove of value to those who were familiar with it? 

2. A second area of interest was the mechanical model used for 
simulating the combination of sign wav« to form a complex wave. 
Fourier synthesis is not normally taught this way, and at least one 
of the presenters was uneasy about using a mechanical model. Would 
it cause misconceptions in students, or emphasise irrelevant aspects 
of the machinery, rather than illustrate the principle itself? 

3. Another problem was not knowing what students following the course 
were wanting from television programmes. The course team had 
decided to use television to a considerable extent to demonstrate 
practical applicatiom of instrumentation in industry. Perhaps 
students would have preferred the programmes to concentrate instead 
on the more difficult points in the correspondence text. (This of 
course is a matter of principle of wider significance than just the 
T291 course.) 

4. The first of the two transmissions of each television programmes on 
this course was at 6.40a.m. in the morning. Similarly, the repeat 
of the radio programme was at 7.00a.m. on a Saturday morning. The 
University is keenly interested in the problem of early morning 
transmis.'^ions, and so another area of interest was the extent to 
which T291 students would use such early morning slots. 

5. Finally, the evaluators were concerned to discover how students made 
use of the television programme, wh]^ they found the programme useful, 
difficult, enjoyable or the converse, whether they understood the 
purpose of the programme, and whether these factors influenced how 
much students learned from the programme. 

On the basis of these questions, a postal questionnaire was designed, 
(Appendix B). This questionnaire included three content questions. The 
wording of these questions was drawn up 'in consultation with the producer, 
two of the presenters, and the educational technologist on the course team 
(R. McCormick). Normally, tett-type questions are not asked on broadcast 
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evftXufttiont, since if the question! covtr iaportant aspects of tht unit, 
they can usually be knswered from a study of tht corrtspondenCfi text. This 
would have been true in this case, but it was known that the delay in 
nailing the correspondence texts would be such that the texts would not be 
available until most of the Questionnaires ^ttt returned* The three 
questions set were: 

(a) In the measurement of friction in TV6, why is it necessary to 
consider the possibility of lafs between the transducer outputs? 

Cb) How does Fourier analysis help the engineer (or experimenter) to 
overcome the problem of Isf in such a situation? 

(c) Draw a simple block diagram showing the components of the system 

used in comparing the response of damped and undamped acceltrometers 
(demonstrated towards the end of tht programme). This should 
include an indication of how the applied acceleration amplitude was 
kept constant. 

Students were asked to spend no more than 20 minutes on these three 
questions » and to answer briefly and in note form* In the covering letter, 
they were told that the questionnaire would not be used for student 
assessment purposes* 

^rom the 1011 students registered for T291 at that time, a random 
sample of 268 students (27%) was drawn. The questionnaires were mailed to 
students on Monday » 3rd June, during the week following the transmission of 
the television programme. After two reminders to non-respondents, 181 
usable questionnaires were returned, a response rate of 68%. The sampling 
error is ^ 5%. All the open-ended answers to each question are presented^ 
uncodedi in Appendix C. 

A day-school for T291 students had been arranged for Saturday, June 15th 
in London, 12 days after the repeat transmission. With the co-operation of 
Oten Laurence, the staff tutor, the prograrase was shown on video-tape to 
one of the seminar groups, and then discussed afterwards. There were 
thirteen students in the group, plus the producer, one of tht presenters, 
the staff tutor, and the evaluator. The discussion was sound-recorded, and 
the full transcript is presented in Appendix D. 

The part-time tutors on this course were also involved in the CT4 
scheme. This meant that there were course tutor reports on Television 
Programme 6 sent in to the University, and this information has also been 
used. (Appendix £). 

Finally, Blocks Y and Z of CMA T291 45 were used as part of the 
course team's standard feedback procedure* This included a question on 
Television Programme 6. (Appendix F)* 

These sources of information can be summarised as follows: 
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TABLK 5. Sources of Info^wation on Television Profrtmaie 6 . 
No. of studoUs registered at time of profrannet lOll 



Postal questionnaires 
Group discu£.7ion 
Part-time tutors (CT4) 
CMA 45 



No> sampled 

268 

43 
1011 



No> of respondents 

181 

13 

20 
437 



% response 

68% 

44% 

43% 



RHSULTS 
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Viewing and Listening Figures 

On the postal questionnaire, information was requested not only about 
Ahen or if 5tudents viewed Television Progranme 6, but also about the first 
three radio programmes and the first four television progranmes (the fifth 



was 


left out 


of the 


questionnaire by error)* 


Tht results 


of these questions 


ace 


given in 


Tables 


6 


and 8 • 














TABLE 6: 


Student Viewing Figures: Trogranwes 1-6 












(TX « 


transmission) 














No. and % 


1st TX 


2nd TX 


Both 


Neither 










viewing 


Monday 


Friday 


TX 


TX 










at least 


6.40am 


7.05pm 








Total 




one TX 


ONLY 


ONLY 








No. 






No. % 


No. % 


No. % 


No. % 


No. % 


l-V 1 


181 


100 




155 86 


52 29 


82 45 


20 11 


26 14 


iy 2 


181 


100 




152 84 


47 26 


83 46 


21 12 


29 16 


1V3 


181 


100 




148 82 


41 23 


96 53 


10 6 


33 18 


TV 4 


ISl 


100 




132 73 


38 21 


73 40 


20 11 


49 27 


TV 6 


181 


100 




90 50 


9 5 


68 38 


12 7 


91 50 



Notes: 1 



figures % for viewing both transmissions, e.g. TVl « 29% ♦ ii% s 40% 

2. One student saw all programmes 1-4 but could not remember which 
transmission. 

3. Another student saw TV 6, but only on video-tape. 

Almost exactly half the students who responded to the questionnaire 
watched Television Progranwe 6. This is at first sight a surprisingly low 
figure, compared with the viewing figures for programmes 1 to 4, which 
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averaged over 70%. However, the first transmission of Television Programme 6 
was at 6.40 a.m. on 27th May, 1974, which happened to be a bank holiday 
(Whit Monday*) Similarly, Table 7 below shows that almost 10% of the 
students were away from home on holiday that week. 





TABLE 7: Reasons for missing Television Procramrae 


6. 


Code No. 


Reasons given 


No. of students 


% of 181 


(Appendix C) 


for not watching 


who did not view 


respondents 


3/6/9 


Ifork reasons 


18 


10 


I 


Away on holiday 


IS 


a 

V 


2 


Forgot/no particular 
reason. 


14 


8 


5 


Other commitments 


12 


7 


7 


Transmission times 
not suitable 


10 


6 


4 


Away overseas 


6 


3 


8 


New baby/illness/ 
hospital 


3 


2 


13 


Too much study/too 
little time 


3 


2 


10/11/12/14 


Other reasons 


7 


4 


16 


No answer 


6 


3 




All responding 
students 

(some students 


94 

gave more than one r 


53 

eason) 



These results indicate the comparative value of early mcming 
broadcasts. Although the Monday morning transmission was used by only 
a minority of students (between 30% - 40% for programmes 1-4), nevertheless 
the transmissions helped considerably in ensuring high viewing figures 
overall for the course, up to the time of enquiry. No Friday evening 
figure exceeded two-thirds of the registered students, and when some 
students, not surprisingly, showed a reluctance to get up for 6.30 in 
the morning on a Bank Holiday, this had a marked effect on the overall 
figure, since the numbers watching the Friday evening transmission on 
31st May hardly dropped at all. Five students taped th<^ sound of 
Television Programme 6. 
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TABLE 8: 


Student listening figures; 


ProRramm 


es 1-3 










(TX = transmission) 














No. and % 


1st TX 


2nd IX 












listening to 


Thursday 


Saturday 












at least 


7.10pm 


7.00am 


Both 


Neither 






Total 


one TX 


ONLY 


ONLY 


TX 


TX 






No. % 


No. % 


No. % 


No. % 


No. % 


No. % 


Radio 


1 


181 100 


110 61 


86 48 


20 11 


4 2 


71 39 


Radio 


2 


181 100 


101 56 


82 45 


17 9 


2 1 


80 44 


Radio 


3 


181 100 


84 46 


64 35 


17 9 


3 2 


97 54 



The radio figures began reasonably well (61%) but by programme 3 had 
dropped to 46%. Few students (less than 15%) listened on Saturdays at 7.00a.m. 
These figures are disappointing, since this course uses a form of radio- 
vision, combining the radio programmes with detailed broadcast notes, through 
which the student is led during the course of the broadcast. Perhaps even more 
disappointing though was that over a quarter of the students had not 
listened to any of the first three radio programmes. Once again though 
in these evaluation studies, there are marked individual differences, since 
another quarter of the students had not missed a single programme, television 
or radio. Indeed, 69% of the students had seen at least four out of the 
five television programmes about which they were asked. A very small 
number of students (13) neither watched nor listened to any programmes, and 
of these, four were overseas or lived outside BBC 2 and VHP transmission 
areas, and the rest found the times of the programmes too inconvenient. So, 
although there is a large group who do not listen to radio programmes 
regularly, this do^s not apply for the television programmes on this course. 
(Table 9) 





TABLE 9: No. of 


students 


who have watched 


and 


listened 






to various numbers of pro 


grammes 














All 


Watched 


Did not 






respondents 


TV 6 


Watch 


TV 6 


Table 


9(a) Television 


No. 


% 


No. 


% 


No. 


% 


All 5 


TV programmes so far 


69 


38 


69 


77 


0 


0 


4 out 


of 5 TV programmes 


56 


31 


20 


22 


36 


40 


3 out 


of 5 TV programmes 


29 


16 


1 


1 


28 


31 


2 out 


of 5 TV programmes 


9 


5 


0 


0 


9 


10 


1 out 


of 5 TV programmes 


4 


2 


0 


0 " 


4 


4 


None out of 5 TV programmes 


14 


8 


0 


0 


14 


15 






181 


100 


90 


100 


91 


100 
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TABLE 9 (Cont.) 




All 


Watched 


Did 


not 




respondents 


TV 


6 


Watch 


TV 6 


9(b) Radio 


No* 




No. 


% 


No. 


% 


All 3 radio programmes 


69 


38 


51 


57 


18 


20 


2 out of 3 radio programmes 


25 


14 


12 


13 


13 


14 


1 out of 3 radio programmes 


37 


20 


16 


18 


21 


23 


None out of 3 radio programmes 


50 


28 


11 


12 


39 


43 




181 


100 


90 


100 


91 


100 


All TV atid radio programmes 


45 


25 


45 


50 


0 


0 


No TV or radio programmes 


13 


7 


0 


0 


13 


0 



There is one further point to be made regarding the viewing and 
listening figures. Table 10 shows a considerable discrepancy for Television 
Programme 6 between the figures from the postal questionnaire, and figures ' 
from CMA feedback. 





















TABLE 


10: Comparison between broadcast questionnaire and CMA feedback 


Programme 




















Broadcast 




CMA Feedback 










questionnaire 






















No. of 


















students 


















registered 










No. 






Viewing/ 


at time 




Viewing/ 






sent 


No. 


Response 


listening 


of CMA 


Response 


listening 






out 


returned 


rate(%) 


figures(%) 


cut-off date 


rate (%) 


Figures(%) 


TV 1 




268 


181 


68 


86 


1017 


80 


85 


TV 2 




268 


181 


68 


84 


1017 


78 


83 


TV 3 




268 


181 


68 


, 82 


1017 


71 


83 


TV 4 




268 


181 


- 68 ' " 


73* 


1011 


75 


76 


TV 5 




No. inf. No. inf. 


No. i*Jlf. 


No. inf. 


999 


70 


75 


TV 6 




268 


181 


68 


50 


985 


46 


66 


Radio 


1 


268 


181 


68 


61 


1017 


76 


67 


Radio 


2 


268 


181 


68 


56 


1017 


73 


63 


Radio 


3 


268 


181 


68 


46 


No. inf. 


No. inf. 


No.inf • 



These discrepencies are important i because a number of course teams base, 
maintenance and remake decisions on CMA feedback. Although the base for 
CMA returns is all registered studentsy the actual response rate^ after the 
first couple of months of a coursei based on questions about television and 
radio that are actually answered » tend to be lower than for the specially 
designed questionnaires for broadcast evaluation. There ia evidence from 
other studies thati irrespective of the source of information (CMAs» course unit 
report formsi special postal questionnaires) » the lower the response rate» 
the greater the bias in respondents towards students who view and listen 
(see Bates> 1973| and Broadcast Evaluation Reports Nos. 2 and 4). There is 
also evidence that non-viewers are more likely to drop out than viewers 
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(Broudcast Bvaluution Report No. 4). This reinforces the view that it is 
better to have a high response rate based on a small repres.^ntative sample 
than to rely on larpe numbers of returns, if these returns nevertheless 
constitute a lower response rate. The lower the response rate, the 
greater the iikely overestimate of viewing and listening figures. For 
this reason, although the number of CMA returns for Television Programme 6 
is greater than the number of postal questionnaire returns for Television 
Programme 6, we place greater reliance in the questionnaire returns. Indeed, 
wc would guess that even the viewing figure of 50% is an overestimate for 
the total number of students registered at the time of the programme (but 
nevertheless is not likely to be less than 45%). Consequently, the CMA 
figure of 66% is very likely to be misleading, and certainly as a course 
progre55« and the number of CMA returns decrease , CMA figures are likely to 
give increasingly large overestimates of the proportion viewing and listening. 

Student reactions to TV 6 . 

In analysing student reaction to the programme , we have examined not 
only the quantitative information from the pre-coded answers, but also the 
qualitative information from the open-ended answers. It is important that 
the answers to questions on usefulness, enjoyment, difficulty, purpose, and 
the test-type questions are taken as a whole. 



If this is done, it is quite clear that the programme was positively 
received by about 70% of the students who watched, while conversely about 
30% reacted negatively to the programme. 





TABLE 11: Student reactions 


to Television Programme 6. 








No. of students 


% of viewers 


USEFULN£SS 


Very useful 


19 




21% 




Fairly useful 


44 




49% 




Not very useful 


24 




27% 




Not at all useful 


1 




1% 




Oon*t know 


2 




2% 




All students who watched 


90 




100% 


BNJOYMEffT 


.ery enjoyable 


12 




13% 




Quite enjoyable 


34 




38% 




All right 


36 




40% 




Not very enjoyable 


6 




7% 




Not at all enjoyable 


1 




1% 




DonU know 


1 








All students who watched 


90 




100% 


DIFFICULTY 


Very difficult 


3 




3% 




Fairly difficult 


20 




22% 




Just right 


39 




43% 




Fairly easy 


17 




19% 




Very easy 


8 




9% 




Oon*t know 


3 




3% 




All students who watched 


90 




100% 
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Those who reacted negatively can be broken down further into three roughly 
equal groups: those who totally failed to see the purpose of the programmei 
or wanted to suspend judgement until they had seen the text; those who 
thought the prograimne was of little value, because they had already studied 
Fourier analysis and synthesis, and claimed therefore to have learned 
nothing new from the programmej and finally those who realised that the 
programme was concerned with the application of Fourier analysis to the 
problems of measurement caused by time-lag in transducers » but did not 
feel that the programme had succeeded in this aim. 

This latter point reflects that behind the positive reaction of 70% of 
the students, there lie some doubts about the success of the programme in 
achieving its objectives » and therefore it is important to examine the 
information on student reactions very carefully. Few students found the 
prograimc uncnjoyable (7 out of 90). In particular » the mechanical model 
was tiipecifically mentioned in favourable terms by nearly half the viewers 
(44%) » Furthermore, only a quarter rated the programme fairly or very 
difficult. This figure is surprising, for a number of reasons. The programme 
was made on the assumption that students would have already studied the 
relevant part of the text, while we know that this was not possible. It is 
even more surprising in the light of the poor results of most students on 



questions set on the content of the programme. 



TABLE 12 - Answers to Content Questions 




GRADB 




All 


A 


B 


C 


D 




students 






Relevant j 


No answer y 


Question 


who 


Satisfactory 


Part of 


but ho 


wrong. 




watched 


answer 


answer 


explanation 


irrelevant 




No. 


No. % 


No. % 


No. % 


No. % 


9a) In the meas- 












ureinent of friction 












in TV6 why is it 












necessary to consider 90 


27 30 


9 10 


17 19 


37 41 


the possibility of 












lags between trans- 












ducer outputs? 












9b) -How does Fourier 












analysis help the 












engineer to overcome 


90 


16 18 


13 14 


10 11 


51 57 


the problem of lag in 










such a situation? 












9c) Draw a simple 












block diagram show- 












ing the components of 










the system used in 












comparing the response 










of damped and undamped 










accelerometers 


90 


19 21 


7 8 


3 3 


61 68 


(demonstrated towards 










the end of the prog- 


1 










ramme). This should 












include an indication 










of how the applied 












acceleration 












amplitude was dept 












constant . 
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^^ow some of the weaknesses of performance-type tests have already been 
outlined earlier (pp.4 and 20-21)* Despite consulting the producer, the 
central academic, and the educational technologist, two of the questions 
were unsatisfactory. Dr. Smol thought that 9b was too difficult to answer 

from the programme alone, and the last part of 9c ("This shoUld kept 

constant") referred to a part of the programme which was removed in the 
final video editing. In addition, there is evidence that some students 
did not give these questions the same kind of attention that they would have 
done if their answers had counted towards their assessment. Finally, some 
students already had sufficient prior knowledge to answer the questions 
without having to see the programme. (One student actually described 
equipment which one might have been expected to use, rather than the very 
latest equipment that was actually shownS) fiven allowing for these weaknesses, 
though, on none of the questions did more than 40% of the students provide, 
at a minimum, even part of the answer. 

The discrepancy between the students* subjective and largely favourable 
reaction to the programme, and their actual difficulty in recalling the 
major content of the programme, can perhaps be explained by their view of 
what the programme was about (see Table 13). For most students who viewed 
(82%), the cle£.rest and most valuable part of the programme was the 
explanation of the synthesis and analysis of complex wave forms. However, 
the application of Fourier analysis to instrumentation problems, and in 
particular to the problems caused by phase-shift and time-lag, was far less 
frequently mentioned (37%). For instance, while about three-quarters of the 
viewers mentioned specifically the explanation of Fourier analysis and 
synthesis, spectrum analysis, or the effects of adding harmonics to the 
fundamental wave» as being one of the main purposes of the programme, only 
a quarter specifically mentioned phase-shift or the problems of time-lag. 
(In addition, another fifth - 23% - were unable to offer any suggestion as 
to the purpose of the programme.) 



TABLE 13: Identification of value and purpose of 


programme 




Any mention 


Purpose 


of programme 




No. % of viewers 


No. 


% of viewers 


Fourier analysis/synthesis/ 








complex wave, etc. 


74 82 


66 


73 


Mechanical model, visual aids. 


40 44 


3 


3 


Time-lag, phase-shift. 


33 37 


25 


28 


Damped/undamped accelerometers. 


5 6 


2 


2 


Actuators/f riction/stictiorvr 


2 2 


2 


2 


Didn*t know purpose, no answer. 


Not applicable 


21 


23 


Despite so few students mentioning phase-shift and time-lag. 


nevertheless. 


just as many students (about a dozen) 


mentioned that they 


did not 


understand 



the application of Fourier analysis to the problem of time-lag or phase-shift 
in transducers as students who had doubts about whether they really understood 
Fourier analysis. Q <1 
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It seems clear therefore that the students enjoyed the programme and 
found it useful because of the novel way it dealt with Fourier synthesis and 
analysis. Since 61% of the students already had sotne previous knowledge of 
Fourier analysis, and an even higher proportion - 83% - had work experience 
as an electrical or mechanical engineer, it appears that this enabled them 
to enjoy the programme, despite not having studied the unit. Furthermore, 
just over half the actual programme was devoted to an explanation of 
Fourier synthesis and analysis, and spectrum analysis, which together with 
student familiarity with the former might explain why the application of 
Fourier analysis, and the problems caused by phase-shift and time-lag, failed 
to register with most students. 

The Broadcast Notes . 

The broadcast notes suffered from printing difficulties to some extent 
in the same way as the correspondence text. Those responsible for the 
programme were aware that the notes were inadequate, but an effort was 
nevertheless made to get the brief notes that had been prepared to students 
in time, by means of a special mailing. Even this proved difficult. Over 
20% of the students who viewed reported that they had not received the notes 
at the time of returning the questionnaire, which in most cases was at least 
a week after the repeat transmission. It is likely though that some students 
were anticipating fuller notes, and therefore were \mawarc that they had 
actually received all the notes they were going to get. Whatever the reason, 
a third of the students had not read the notes by the time they completed 
the questionnaire. Not surprisingly, of the 56 students who had read the notes, 
two-thirds found them insufficient. It is interesting nevertheless to 
examine the reasons given for students finding the notes insufficient, as it 
gives a chance to see what students are looking for in broadcast notes. 

The most common request (14 students) was for more diagrams and 
photographs of the equipment and the oscilloscope traces, primarily to act 
as reminders, for revision purposes. A smaller mumber of students (seven) 
specifically asked for more detail of the academic content of the programme - 
the relevant theory, the main principles - to be summarised in the notes. 
Four students wanted the notes to follow up the programme in some way, for 
instance by giving more information about the final demonstration, or by 
explaining "how Fourier synthesis can be used to model mechanical system 
response." It must be remembered though that at this stage the students had 
not received the correspondence text, and some of these points should have 
become clearer after studying the texts. 

Reaction to Television on the Course as a Whole 

The great majority of students (84%) found telcviaion of at least some 
value on the course. Of those who could watch and also answered the 
question (173), only 21 - or less than 1 in 8 - answered "not of much value" 
or "no value at all." No outstanding reason emerged for these s^udents 
finding television of little or no value, although 17 students in nil 
mentioned the inconvenience of the transmission times, and about 10 
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mentioned that there was not enough theoretical or ihtellectually 
demanding material in the prograiMiea* 

Students were asked to ^tate a preference for tht kind of programme 
they would like. The anawera are given in Table 15, 

TABLB 14 I Kind of television programme policy preferred by T291 atudenta » 



Policy 


No. of 

students % 


A. Concentrate almost entirely on 

extending or reinforcing the basic 
theoretical concepts in the 
correspondence texts, through 
deaonstrstions and illuatrated 
lectures* 


43 24 


B* Mostly as (A)| but also spend 
at least some time demonstrating 
the practical application of the 
basic concepts in the correspond- 
ence textSf by filming and 
discussing industrial and 
reaesrch application* 


129 71 


C* Use in some o*:het way 


7 4 


No answer 


2 1 


All responding students 


1«1 100 



The majorit*y of students on T291 appear to be clearly in support of 
the general policy for television laid down by the course team. Most 
students evidently » despite the pressures of studying part-time, are atill 
interested in the apg^lications of the concepts they learn in the correapondence 
texts. 

Finally > in order to discover whether there were special factors 
about the course, such as overloading or excess difficulty, which might 
have influenced unduly students* reaction to Televiaion Programme 6, two 
general quest iona were asked about the course aa a iihole. A lot of students 
gave detailed comments, and our interpretation of the main points made IS 
summarised as follows: 

1. Most students appeared to be finding the courae intereating, but 
somewhat difficult, particularly the emphasis on electronics for 
those with little previous knowledge of electricity. 

2« Some students were also finding the course a little disjointed. 
No doubt the unavoidable delays in receiving texts was not helping 
to keep the course together, but a number of students commented 
that the course waa not so coherent as TS282, and several atudents 
also commented that they were glad they had studied TS282 first, 
because of the help it gave them with T291. 

3. Ihe main criticisms however - strongly supported by the tutors, 
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incident ly - appeared to be of the first set of TMAs and CMAs. A 
number of students and tutors expressed the opinion that these 
either did not test sufficiently students* understanding of the 
basic principles covered in the course , or assumed knowledge which 
the student could not have derived from the course itself. 

4* There were a number of comments on the poor quality of the binding 
and paper used in the correspondence texts, resulting in the texts 
disintegrating after a little use, in contrast to texts on other 
OH courses. 

In general y however, most students who returned the questionnaire 
seemed to be enjoying the course and consequently there appear to be no 
special factors other than the delay in receiving the units which are likely 
to influence unduly students* reactions to Television Programme 6. (The 
summary above however does not do justice to the wealth of comments on the 
course supplied by students^ and the T291 maintenance course team in 
particular might find it valuable to read through the full comments from 
questions 14 and 15 in Appendix C) 

DISCUSSION 

There is a number of interesting issues arising from these results and 
from our description of the television programme in the context of the 
course as a whole. The discussion of these issues that follows inevitably 
reflects a more personal view and is offered more tentatively than the 
previous sections of this report, but nevertheless it might be valuable 
in stimulating thought about the more general issues arising from the study. 

First of ally let us look at where the course team*8 policy regarding 
television, and the programme itself, has been clearly successful. 
Certainly, the programme covered ground which would have been extremely 
difficult to cover in any other way in the Open University system. Besides 
the wide range of equipment and its operation demonstrated in the programme 
which would be clearly impossible to provide through home experiment kits, 
an abstract concept (Fourier analysis and synthesis) was successfully 
demonstrated by using ingenious mechanical models. Indeed, because of the 
large numbers of students who are likely to follow the course (probably 
5,000 to 6,000 over the life of the course), the high cost of constructing 
such a model is probably amply justified, and resulted in the teaching of the 
concepts in a way that is beyond even a conventional university. Furthermore, 
there is no doubt from the results that most students, despite having some 
previous acquaintance with Fourier analysis, found this aspect of the 
programme very clear and helpful* In addition, the policy of mixing .the 
extension or reinforcement of basic concepts with demonstrations of the 
application of these concepts in industry and research was widely supported 
by most students on the course. Finally, the programme was well-integrated 
with the rest of the unit, and indeed, course tutors reported that students 
did in fact draw on the programme for their TMA answers. 

Nevertheless, despite these clear successes, there are serious doubts 
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about some aspectsi of the progranrae. There was clearly an educational 
intent behind the programme, but equally clearly there was a mismatch 
between what the course team saw as being the main aim of the progranmei and 
what the majority of students perceived to be the main aim. l*he students 
clearly recalled the demonstration of Fourier synthesis and analysis, but 
most were unable to follow the relationship between this and the problems 
caused by phase-shift and time-lag in transducers, which appeared to be the 
main aim of the programme, from the course team^s point of view. It does 
appear that ironically, the failure of most students to understand the 
demonstration of phai;e-shift and resonance in damped and undamped 
accelerometers can be partly atttdbuted to the use of the mechanical models 
for demonstrating Fourier analysis and synthesis. An examination of the 
content of the programme (Table 3, pp. 12-15) shows that over half the 
programme was devoted to the explanation of Fourier analysis, synthesis 
and spectrum analysis, and the demonstration of the electronic and mechanical 
models, while the main conceptual ideas regarding the measurement of phase 
and amplirtude in damped and undamped accelerometers were crammed into the 
last six and a half minutes. The striking visual impact of the models, and the 
time needed to demonstrate them, the previous acquaintance of many students 
with Fourier analysis, the lack of clear and detailed notes to direct students 
clearly to the main aim of the programmes, and the delay in students 
receiving the texts, all combined to place greater emphasis on the explanation 
of Fourier analysis than on the newer and more difficult aspects of measuring 
phase-shift and amplitude in transducer response systems* On the other hand, 
the model clearly made a concept with which many students were already 
familiar much clearer. The lesson perhaps is that care must be taken to 
ensure that such powerful visual techniques are used, but kept under very 
tight control, in terms of the time devoted to their demonstration. Thus 
in this particular programme, it appears that less time spent on the models, 
and more time on the latter part of the programme, was needed, and that 
broadcast notes showing the aims of the programme, the link between 
Fourier analysis and the problems of measuring phase-shift and amplitude in 
transducer response systems, and diagrams of equipment and the main traces are 
also necessary, even though this is partly covered in the correspondence 
text. (This is because it is optimistic to assume that most students will 
be on schedule with their reading of the texts when the broadcast is trans- 
mitted - see below). 

It may also be worth making one further point on Fourier analysis. This 
has been the subject of television programmes on TlOO, TS282, M201 and 
SM351, at least. Although different aspects of the subject have been dealt 
with, it is obviously a subject which not only lends itself to television, 
but which is of key importance in Mathematics and Technology. There might 
be a case for this being included within the remade Technology ^nd/ot 
Mathematics foundation courses. Also, the Open University library has now 
nearly completed its cataloguing of television programmes. With increasing 
costs and the pressure on transmission time, it would be sensible to make 
use of this cataloguing system to avoid duplication, at least in production. 
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of such key areas as Fourier analysis* 

The study also throws interesting light on the problem of scheduling 
and transmission times. The course was very carefully designed so that 
for students working on schedule) the programmes would be transmitted to 
fit in with their studies. Thus one week was given for study of the 
relevant correspondence text before the transmission of the programme^ if the 
student had completed work on the previous block by completing TMA 02 and 
CMA 43 and 44 by the due dates. However | even if the texts had been mailed 
in time, previous studies (e.g. Bvaluation Reports 1 and 2) show that it is 
overoptimistic to expect students to be on schedule, as measured by the 
duo dates. Most students work to cut.^off dates > particularly when studying 
more than one course at a time. In is unrealistic therefore to expect most 
students to have read the relevant text before seeing a programmei if the 
planning is such that there is only one week between receipt of the text and 
transmission of the programmei particularly if the course is a half*credlt| 
or if the cut-off date for the TMA is 2^ months awayi or if the cut-off 
date for assignments for previous units comes later than the transmission 
of the programr.ic. 

There are a number of ways around the problem. The simplest is to move 
the cut-off dates nearer to the time students are meant to finish their work 
on a particular block. Alternatively) some of the relevant parts of the 
text could be summarised or condensed in the broadcast notes (although if 
they are too long, students are not likely to read these either.) Another 
solution may be to make a variety of programmesi some introductory or self- 
sufficient) others relying on the previous study of the correspondence texts | 
but transmitted later in the course. Bach course-team will have to decide 
its strategy according to the shape of a course as a whole. Nevertheless) 
if students are to obtain maximum benefit from the broadcasts) planning 'must 
be such that there is a much more realistic appreciation of the way students 
study in the Open University than has occurred on many courses to date. 

Finally) there is the question of early-raornlng transmission timet. 
Somewhat to our surprise) there is a substantial minority of T291 students 
willing to use the 6.40a.m. transmission slot on a Monday) sufficient to 
ensure respectable overall viewing figures » even though quite a lot of students 
categorically refuse to watch at that time. More critical perhaps is that 
the early morning transmission is the first, with the repeat at 7*05 p.m. on 
a Friday. With an evening transmission as the repeat) there is obviously a 
temptation to avoid the early morning transmission. If something unexpected 
occurs, however) and the evening transmission is missed) there is then no 
opportunity to catch the repeat. It would seem preferable therefore to 
allocate the evening slot for the first transmission, and the early morning 
slot for the repeat. Also, the course team appears to be unfortunate in 
receiving a Monday morning/Friday evening combination, which for some 
students is an awkward arrangement. It would be better if future 
allocations to courses avoided this combination, if at all possible. 
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SUMMARY 



NUMMARY AND RBOOI»*BNmT10NS 



1« The prograrame» from the point of view of the course teaffl| had a very 
clear educational intenti in terns of denonttrating both conctptSi and 
equipment and its use. However i while most studtnts clearly rtcognised the 
aim of explaining the basic principles tinderlying Pouritr synthtsis and 
analysis, few students recogn4sed' and understood the relationship bttwecn 
Fourier analysis and the problems caused by phase-shift and timt-lag in 
transducers. This was due to a nunbtr of reasons i delay in mailing units to 
students, which meant that students could not study the relevant ttxt before 
watching the programme, as planned; the txtent of timt within tht progruMe 
devoted to the explanation of Fourier synthesis and analysis, and tht , 
consequent condensing of the section explaining tht mtasurtmtnt of frtqutncy 
response in damped and undamped nccelerometers; and tht fact that iM>st 
students were already somewhat familiar with Fourier analysis and synthtsis. 

2. The programme used teltvision appropriattly in the Open Univtraity 
context. It showed application of basic instrumentation principles in 
industry and research; presented dynamically a difficult conctpt by mtans of 
modelling and of demonstrating relevant oscilloscope tracings; and also 
demonstrated the actual une of large and expansive instrumentation equipment. 

3. The programme was well-integrated with the text, demonstrating and 
developing concepts covered in the text, and indeed providing material which 
students were able to draw on in their tutor-marked assignments. 

4. About half the students on T291 watched the programme. This figure 
was probably lower than for most other programmes on this course, since it was 
transmitted over a bank-holiday period^ This affected particularly the 
first transmission which was on Whit Monday at 6.40a.m. 

5. The early morning transmission slot, although of no use for many 
students, nevertheless helped to keep viewing figures high as a whole* 

6. Listening figures began at just over 60% for the first radio 
programme » but had dropped to about 4S% for Radio 3. 

7. Most students (over two-thirds) were regular viewers of T29l| with 
a quarter having watched and listened to every programme by the half-way 
stage of the course. Conversely, another 25% had seen or heard no 
programmes at all on T291. 

8. Most students who watched reacted favourably to the prografflne, 
whether or not they had previous acquaintance with Fourier analysis and 
synthesis. 

9. The mechanical models used to demonstrate Fourier synthesis were 
very much appreciated by students, enabling them to understand much more 
clearly the basic principles of Fourier synthesis and analysis. On the other 
hand, over half the programme was devoted to this aspect, partly because of 
the time spent on explaining and demonstrating the models, and this 
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resulted in the Utter part of the progranne, concerned with the 
measurement of frequency response in damped anl undamped accelerowetera, 
being extremely condensed* 

10. The general policy adopted by the courae of uaing television at 
least partly for demonstrating the practical applicationSi in induatry and 
research^ of tha basic concepts contained in the correapondence texta waa 
supported by the majority of T291 atudents. 

ti. The broadcast notes were inadequate (see recotmendation below)* 

12. The study emphasised the need to enaure high response ratea for 
obtaining reliable information on viewing and liatening figurea, low reaponae 
rates giving large overestimates of actual viewing and liatening figurea. It 
also demonstrated that students' subjective reactions to the usefulnesai 
enjoyment and difficulty in a programme do not provide a reliable^ guide to 
the amount of value actually gained from a programme, in terms of under- 
standing the content and the aims of a programme. The study also emphasised 
the difficulty in an evaluation study of setting good performance- type 
questions on broadcasts even when the broadcast has not been reinforced by a 
correspondence text. Therefore there ia a need to use multiple sources of 
information to build up a reliable picture. 

13. The overall picture that emerges of T291 Television Programme 6 
is that it formed a very useful component of the unit and block to which it 
was related^ but that its full potential was not realised) partly due to 
circumstances outside the control of the course team (the industrial 
problems caused by the three-day week), but also partly due to weaknesses 
in course and programme design. 

RECX)MM£NmTIONS 

The general aim of the evaluation exercise is to produce knowledge about 
broadcasts which will help decision-iMking in courses other than the one on 
whicli the study has been carried out, since the opportunity for remaking 
programmes is limited financially, and is often influenced by factors other 
than the value of the programme itself (such as, for example, a decision to 
replace the correspondence text to which a programme is related). However, 
in this particular instance, there is a strong possibility of remaking 
Television Programme 6 on T291. (The decision to do this though is not 
directly related to the evaluation.) Therefore these recommendations are 
both more detailed than on other of the evaluation studies, and are intended 
more as a basis for course-team discussion than as unchallangeable 
recommendations for action. 

1. Because of the strong possibility that large nunbers of atudents 
will not have read the relevant correspondence text before the television 
transmissions, the T291 maintenance team may wish to re-examine the course 
calendar, to see whether Television Programme 6 - or any other progranme 
which assumes prior study of the texts - could be transmitted more than one 
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week later than the «itarV-d»tc for Units 8, 9 and 10. TT^e maintenance teaii 
way also like to re-examine the desirability of cut-c^f date* for TMAa and 0«A» 
Calling no laic after students are supposed to havt watched programmta, 
ijiven the way student^* tend to »»hunch" thtir atudying in the period 
iPMediately preceding cut-off dates* Alternatively, the courat-team may prefer 
to remake Television Proframme 6 aa an introductory proframmt to Fourier 
analysis and synthesis, possibly Incorporating not orAy the present section 
on Fourier analysis and synthesis, but also parts of other OU programmes on 
5he same subject, if these are relevant. 

2. Two of the* recommendations made regarding transmission times have 
already been taken into account in the 1975 schedules. The Monday morning/ 
Friday evening combination has been avoided, and the early morning tranamiaaion 
is now the repeat. (The new television times aret Sunday, 9.20».m. - firat 
transmission; 7.05a.m. Monday - second tranamiaaion.) 

3. If the maintenance team wiah the programme to continue to examine 
the problems caused by lags in transducers, and the problem of meaauring 
frequency response in damped and undamped accelerometera, then more time 
should be spent on explaining the meaaurement of frequency reaponae in 
damped and undamped accelerometera, and the linka with Fourier analyaia and 
the problem of lag^probably at the cxpenae of time apent on explaining Fourier 
analysis and synthesis • particularly regarding the demonatration of the 
models. The film of experiments at Bath Univeraity might also be removed, since 
it may be possible to explain the problems cauaed by lag without the film. 

In any case, the broadcast notes should contain much of the explanation of 
the equipment used to demonstrate frequency response in accelerometera, 
rather than to use the sound commentary to do this, aa ia done at preaent, 
and this may aave further time for a clearer explanation at the end of the 
prograjwnc of the links between Fourier analyaia, frequency response in 
accelerometera, anci the problems cauaed by lag. 

4. As well as including descriptions of the equipment aa outlined in 
(3) above, the broadcast notea should include! 

(a) a clear statement of the objectives of the programme, eapecially 
the intention to relate Fourier analysis to problems of lag (if 
this is the caae) 

(b) diagrams and photographa of all the equipment demonatrated 

(c) diagrama of the relevant oacilloscope tracea. 

5. Finally, this may be a point which has ariaen due to a lack of 
expertise in instrumentation by the evaluatora, but it ia alao a point raiaed 
by several students. The programme begina with a problem - the effect of lag 
when comparing transducer responses. Does the meaaurement of the frequency 
response of damped and undamped accelerometera actually solve the problem? It 
appears from the analysia of the programme that thiaproblem is not actually 
r»-solved during the programme. If this is the case, the students need to be 
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told this fact, and the subsequent relevance of Fourier analysis and the 
measurement of the frequency response of accelerometcrs needs to be 
carefully explained, if necessary by cross-referencing to the 
correspondence text« 
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